Skip Navigation
Skip to contents

JEEHP : Journal of Educational Evaluation for Health Professions

OPEN ACCESS
SEARCH
Search

Author index

Page Path
HOME > Browse articles > Author index
Search
Paul Orrock 1 Article
Reliability of a viva assessment of clinical reasoning in an Australian pre-professional osteopathy program assessed using generalizability theory  
Brett Vaughan, Paul Orrock, Sandra Grace
J Educ Eval Health Prof. 2017;14:1.   Published online January 20, 2017
DOI: https://doi.org/10.3352/jeehp.2017.14.1
  • 46,318 View
  • 386 Download
  • 3 Web of Science
  • 3 Crossref
AbstractAbstract PDF
Clinical reasoning is situation-dependent and case-specific; therefore, assessments incorporating different patient presentations are warranted. The present study aimed to determine the reliability of a multi-station case-based viva assessment of clinical reasoning in an Australian pre-registration osteopathy program using generalizability theory. Students (from years 4 and 5) and examiners were recruited from the osteopathy program at Southern Cross University, Lismore, Australia. The study took place on a single day in the student teaching clinic. Examiners were trained before the examination. Students were allocated to 1 of 3 rounds consisting of 5 10-minute stations in an objective structured clinical examination-style. Generalizability analysis was used to explore the reliability of the examination. Fifteen students and 5 faculty members participated in the study. The examination produced a generalizability coefficient of 0.53, with 18 stations required to achieve a generalizability coefficient of 0.80. The reliability estimations were acceptable and the psychometric findings related to the marking rubric and overall scores were acceptable; however, further work is required in examiner training and ensuring consistent case difficulty to improve the reliability of the examination.

Citations

Citations to this article as recorded by  
  • The extent and quality of evidence for osteopathic education: A scoping review
    Andrew MacMillan, Patrick Gauthier, Luciane Alberto, Arabella Gaunt, Rachel Ives, Chris Williams, Dr Jerry Draper-Rodi
    International Journal of Osteopathic Medicine.2023; 49: 100663.     CrossRef
  • Acceptability of the 8-case objective structured clinical examination of medical students in Korea using generalizability theory: a reliability study
    Song Yi Park, Sang-Hwa Lee, Min-Jeong Kim, Ki-Hwan Ji, Ji Ho Ryu
    Journal of Educational Evaluation for Health Professions.2022; 19: 26.     CrossRef
  • Interesting statistics regarding the papers published in Journal of Educational Evaluation for Health Professions in 2017
    Yera Hur
    Journal of Educational Evaluation for Health Professions.2017; 14: 36.     CrossRef

JEEHP : Journal of Educational Evaluation for Health Professions